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WREATH PRODUCT OF MATRICES 


DANIELE D’ANGELI AND ALFREDO DONNO 


Abstract. We introduce a new matrix product, that we call the wreath product of 
matrices. The name is inspired by the analogous product for graphs, and the following 
important correspondence is proven: the wreath product of the adjacency matrices of two 
graphs provides the adjacency matrix of the wreath product of the graphs. This corre¬ 
spondence is exploited in order to study the spectral properties of the famous Lamplighter 
random walk: the spectrum is explicitly determined for the “Walk or switch” model on 
a complete graph of any size, with two lamp colors. The investigation of the spectrum 
of the matrix wreath product is actually developed for the more general case where the 
second factor is a circulant matrix. Finally, an application to the study of generalized 
Sylvester matrix equations is treated. 


Mathematics Subject Classification (2010): 15A69, 15A18, 05C50, 05C76, 05C81. 


1. Introduction 

A classical tool to deal with combinatorial, probabilistic and analytical problems related 
to finite graphs is given by the corresponding adjacency matrix, whose rows and columns 
are indexed by the vertices of the graph, and where the adjacency of two vertices in the 
graph corresponds to a nonzero entry at the intersection of the corresponding row and 
column. A natural question arising in this setting asks what would be the appropriate 
product between matrices associated with a given product of graphs. An easy example 
is given by the direct product of graphs, whose adjacency matrix can be represented by 
the Kronecker product of the corresponding adjacency matrices. Similarly, the Cartesian 
product and the lexicographic product of graphs correspond to the so-called crossed and 
nested product of matrices, respectively (see [3]). The reader can refer, for instance, to 
the papers na [Hills] for definitions and properties of these graph products (see also the 
beautiful handbook lED- 

In this paper, we define an opportune and general operation between two square matrices 
A and B: the wreath product AlB. We show some interesting algebraic properties of such 
product, focusing our attention on the case in which R is a circulant matrix. In this case, 
we are able to provide a reduction formula for the spectrum of the matrix A I B. More 
precisely, even if the matrix A I B has order nm” when A has order n and B has order 
m, we prove that its spectrum can be explicitly determined by computing the spectrum 
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of much smaller matrices of order n. 

It turns out that the wreath product of matrices is the matrix-analogue of the classical 
wreath product of graphs (see, for instance, [n]) : the adjacency matrix of the wreath 
product of the graphs Q and Q' is given hy Al ii A and B are the adjacency matrices 
of the graphs Q and Q', respectively. Sometimes, operations on matrices can have an 
interesting probabilistic interpretation, since they can be used to model Markov chains. 
We want to mention here the papers mu, where two families of Markov chains are 
introduced by using suitable Kronecker products, and the papers mm, where these 
models and their spectral properties are investigated in connection with random walks on 
trees or on more general combinatorial structures. 

In our case, the connection with the probability is achieved by the notion of Lamplighter 
random walk. This is a well known model in the literature, and several papers have been 
devoted to its analysis, mainly in the case where the underlying graph is the discrete line. 
Spectral computations for the Lamplighter random walk and related graphs have been 
developed in the inhnite setting mm, as well as in the hnite setting [lailT]. In this 
paper, we prove that the spectral analysis of the matrix AlB in the case in which A is the 
adjacency matrix of a regular graph, provides the spectrum of the Lamplighter random 
walk on such a graph (see also [9], where the Lamplighter random walk is studied in 
connection with the zig-zag product of graphs): an explicit computation is performed for 
the complete graph. Finally, we apply our results to a uniqueness result for a special type 
of the so-called Sylvester matrix equations. This kind of equations plays a central role in 
many areas of applied mathematics, and in particular in systems and control theory. We 
show that the wreath product allows to represent the coefficient matrix of a system of 
equations, whose solution coincides exactly with the solution of the generalized Sylvester 
matrix equation. 

The paper is organized as follows. In Section [2l we introduce the key dehnition of the 
wreath product of two matrices, and we list its basic algebraic properties. In particular, 
the Lemma [23] is devoted to the description of the block structure of the product matrix. 
In Section [3l the correspondence with the wreath product of graphs is proven (Theorem 
O, and in Corollary 13.31 the transition matrix of the Lamplighter random walk is de¬ 
scribed, in terms of the wreath product of matrices. In Section 01 a linear map F is 
dehned, in order to study the centralizer of a given matrix with respect to the wreath 
product 1 Corollary 14.31) . The Section 0] is entirely devoted to the investigation of the 
spectral properties oi A I B, with a circulant B, via a reduction argument allowing to 
describe the spectrum of the matrix product by computing the spectrum of a family of 
matrices having the same order as A (Theorem [ST]); the spectrum is explicitly described 
in the case of A of order 2 fCorollary 15.2[1 . and in the case of a diagonal A and a uniform 
B fTheorem 15.4[1 . An application of these computations provides the explicit spectrum of 
the Lamplighter random walk on the complete graph iTheorem 15.61) . Finally, in Section 
O we show that the so-called generalized Sylvester matrix equation can be rewritten by 
means of the wreath product of matrices (Proposition 03]), and we give in Corollary 16.31 
a sufficient condition for the uniqueness of the solution to this problem. 
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2. Wreath product of matrices: definition and basic properties 


We introduce in this section the main dehnition of the paper, that is, the wreath product of 
two square matrices of any order. We also list a series of properties of this operation, that 
are a straightforward consequence of the given dehnition. In Subsection 12.11 we study 
in the detail the block structure of the matrix A I B, and we deduce some interesting 
properties of its determinant. 


We denote by Aimxn{C) the complex vector space of matrices with m rows and n columns 
over the complex held. We write A4n(C) instead of Al„xn(C), and we denote by In 
the identity matrix of order n. We recall that the Kronecker product of two matrices 

^ (®u)j=l,...,m;j=l,...,n ^ •''^mxn(C) aud B (bhk)h=l,...,p;k=l,...,q ^ Is dehued tO 

be the mp x nq matrix 


A®B 


auB 

dlriB 

(^mlB 

^mnB 


We denote by A^" the iterated Kronecker product A i 


A. We put = 1. 


n times 


Definition 2.1. Let A G Aln(C) and B G A4m(C), where m and n are two positive 
integers. For each i = 1,... ,n, let Ci = {chk)h,k=i,...,n ^ Aln(C) be the matrix defined by 

1 if h = k = i 
0 otherwise. 

The wreath product of A and B is the square matrix of order nm^ defined as 


^hk 


AlB = ll^®A + ®B® I®"-' ® Ci. 

i=\ 


We will show (see Corollary 14.3p that the wreath product dehned above is in general not 
commutative, even if the matrices A and B have the same order. On the other hand, the 
following proposition holds. 

Proposition 2.2. The wreath product AlB satisfies the following quasi-associative laws, 
with respect to the product by a scalar, and quasi-distributive laws: 

• {hA)lB = h{Al{\B)) and Al{hB) = h{{\A)lB), VhGC,/i^0. 

• Al{B + C) = (AA) I B + (/iA) IC and {A + B)lC = Al (AC) + B I {pC), 
where A, /i are any two complex numbers such that A + /r = 1. 

Proof. It follows from Dehnition 12.11 □ 


If we denote by Op the square zero matrix of order p, for every p G N, then we have: 


AlOm = /®" ® A, for every A G A1„(C); 
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• OnlB = ® a, for every B e 7U^(C). 

Moreover, if one between M or S is the identity matrix, or a multiple, we obtain: 

• A I (him) = 0 (A + hln), for every A e Mn{C)] 

• (hln) I B = hlnm^ + ^ B® ® Q, for every B e Mm(C). 

As a consequence, for all h,k E C, one has: 

(^hln) I {kim) (h “1“ k')Ijim" ■ 

In particular, it follows that 

(1) {hln) I {~hlm) = Onm”, Vh G C : 

in other words, the wreath product of two scalar matrices (whose order is not necessarily 
the same) with opposite entries is zero. 

Finally, in the particular cases where n = 1 or m = 1, we have: 

{a)lB = B + alm, Va E C, B E Mm(C); Al(b) = A + bIn, Vb E C, A E Mn(C). 

Proposition 2.3. The wreath product of two symmetric (resp. skew-symmetric, Hermi- 
tian) matrices is a symmetric (resp. skew-symmetric, Hermitian) matrix. 

Proof. It is known that the Kronecker product is associative, that is: A ® {B ® C) = 
{A ® B) ® C. Moreover, the Kronecker product satishes the following property with 
respect to the transposition and conjugate transposition: 

{A®B)^ = A^®B'^ (A® B)* = a* ® B*. 

Therefore, it follows from Dehnition l2.ll from the linearity of the (conjugate) transposition 
and from the fact that 

I = r = 

that one has: 

(AlB)^ = {A^)l{B^) and {Al B)* = (A*) I (B*), 'iA E MnifC.), B E Mn,{C) . 

The claim follows. □ 

Finally, we mention the following property of the trace of the wreath product of two 
matrices: 

tr{A I B) = m"“^(mtr(A) + ntr{B)), VA G ATn(C), B E Adm(C), 

which is an easy consequence of the well known property tr(A ® B) = tr(A)tr(B) of the 
Kronecker product. 
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2.1. The block structure oi Al B. It follows from Definition 12.11 which makes use of 
the iterated Kronecker product of n matrices of order m and one matrix of order n, that 
the matrix A I B has an iterated block structure. More precisely, it can be regarded as an 
m X m block matrix, whose blocks are matrices of order nmP~^, obtained by computing 
the hrst Kronecker product in each summand appearing in the dehnition. On the other 
hand, each of these blocks has an m x m block structure with blocks of order 
This argument can be recursively applied, until we get minimal blocks of order n, which 
may have the form bijCk, where bij is an entry of B, and k G {1,... ,? 7 ,}, or the form 
^ k'hCh, with some suitable coefficients p/j G C (see Example 12.51 for the case 

n = m = 2). In the next lemma, we give a detailed description of such blocks. 

Lemma 2.4. Let A G A1„(C) and B = ^ Alm(C). 

(1) Let i,j G {1,..., m} and /c G {1,..., n}, with i ^ j. Then the number of blocks of 
type bijCk appearing in AlB is niA~^. More precisely, in the matrix AlB regarded 
as an m"’ x m"' matrix whose entries are blocks of order n: 

• the blocks of type bijCk, with k = 2,... ,n — 1, appear at position 

{{i - l)m"-^ + s + {j - l)m”-^ + s + 

with s = 1 ,..., t = 0,..., — 1 ; 

• the blocks of type hjCi appear at position 

{{i — l)m”'“^ + s, {j — + s), 

with s = 1, 

• the blocks of type bijCn appear at position 

{i + tm, j + tm) 
with t = 0 ,..., — 1 . 

(2) Let us order the set {bn ,..., bmm} so that bn < bjj if i < j. Let 

D { (^ 1 ) • • • ) ^n) ■ bi G {bn :■■■') bmm} } 

be the set of ordered n-tuples of elements from {fen,..., bmm}, endowed with the 
following lexicographic order: 

{bi,... ,bn) < {b},..., b'^), if i = min{h : bh 7 ^ b'f^} is such that bi < b[. 

Then the p-th diagonal entry of AlB, regarded as an m"' x m” matrix whose entries 
are blocks of order n, is given by 

n 

+ X] ^fh+ijh+iCh, 
h=l 

where (/i,..., /„) is such that p = 1 + , with fh G {0,..., m — 1}. 

Moreover, (/i,...,/n) is the p-th n-tuple of Q, with respect to the lexicographic 
order introduced above. In particular, there is a bijection between the elements in 
D and the m" diagonal blocks of Al B . 




6 


DANIELE D’ANGELI AND ALFREDO DONNO 


Proof. (1) Notice that, if we determine the explicit positions of the blocks of type bijCk, 
then we automatically get the number of such blocks, which turns out to be equal to 
So it is enough to prove the second part of the statement. We treat here only the 
case 1 < k < n, the extremal cases being similar. First of all, observe that the blocks of 
type bijCk are given by the /c-th summand 

®Ck. 

More precisely, the factor bij ® ® Ck gives rise to rrP~^ consecutive blocks bijCk 

occupying the main diagonal of . This contribution is taken into account by the 
index s which represents a shift along the main diagonal of the corresponding block. 
Inside the matrix A I B, seen as a matrix of order m"" with entries given by n x n blocks, 
we have copies of the same block bij®I^ ®Ck, because of the initial factor 
These copies are shifted on the main diagonal by a factor This is taken into 

account by the index t in the formula. The result follows by observing that the first pair 
of indices corresponding to a position occupied by b^jCk is 


( 2 ) Let us think again of the matrix Al B as a. matrix of order m"', whose entries are 
square matrices of order n. This m"" x m"' matrix can be regarded as a block matrix of 
order m, whose blocks are matrices of order Scrolling down, the block Mk of order 

occupying the A:-th diagonal entry of A ^ S is of type 


A + bkkil 


n—1 






C, 


2 + 1 ? 


2 = 1 


with /c = 1,..., m. In particular, all the blocks of order n in the main diagonal of the 
/c-th block Mk of order rrP~^ oi Al B contain the summand A + bkkCi. Now notice that 
the entry (p,p) oi A I B, seen as a block matrix of order m”, belongs to Mk if in the 
expression p = 1 + Yl'h=i the coefficient /i + 1 equals k. This implies that at the 

entry {p,p) we will hnd a matrix containing the summand A + Now zooming 

into this (/i + l)-st block Mp+i of order (containing (p,p)), we regard Mp+i as 

a block matrix with blocks (on the main diagonal) M[, ..., M^^ of order Scrolling 

down, the blocks occupying the main diagonal have the form 

® A + bkkiT~" ®Ci + buC~^ ® C2+ 


n—2 

+ ® (9 C.+2, 

i=l 

with f = 1,..., m. In particular, all the blocks of order n in the main diagonal of the t-th 
block M^ of order in contain the summand A + bkkCi + 64 + 2 - Now notice 

that the entry (p,p) of AlB belongs to the block M'^ (inside Mk = if the coefficient 

/2 + 1 equals t. This implies that at the entry {p,p) we will find a matrix containing the 
summand A + jj+iCi + fo/ 2 +i,/ 2 +iC' 2 - We can apply recursively this argument. It is 
easy to see that the order in which two different matrices of type C := A + Yfjh=i ^hCh and 
C -.= A + 'Yl'h=i appear in different diagonal entries coincides with the lexicographic 
order of hi defined above. In fact, two different diagonal entries are occupied by different 
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expressions C and C because at some step of the recursive method they will belong to 
different submatrices and (with i < j, for example) of order This 

is equivalent to say that the following inequality in the lexicographic order in hi holds: 
(ci,..., c„) < {c[,..., c'„). The +1 that appears in the equality p = 1 + 
takes into account the fact that the position (1,1) corresponds to fh = 0 for any h. It 
is clear from the construction that there is a bijection between the set of the n-tuples of 
fhS over {0,1,— 1} and the diagonal blocks oi AlB (regarded as a matrix of order 
m'^). The first of such sets uniquely determines the n-tuple {bi,... ,bn) G hi consisting of 
n elements from {^n,..., fomm}- This concludes the proof. □ 


Example 2.5. Let A E A42(C) and let B = 


E A42(C). Then A I B is a 


bn bi2 
^21 ^22 

square matrix of order 8, which can be regarded as a square matrix of order 4, whose 
entries are square submatrices of order 2: 


/ A 611 (Cl + C2) 

^12^*2 

612(^1 0 \ 

^21^2 

A + ^llCi + ^22^2 

0 &12C1 

^21^1 

0 

A + 622C1 + 611C2 ^12^*2 

V 0 

^21^1 

&21C2 A + 622(^1 + ^72) J 


Observe that each block of type bijCk, with i ^ j, appears twice off the main diagonal; 
moreover, all the blocks on the main diagonal are distinct, and ordered according with 
the lexicographic order of the pairs {{bii,bjj) : i,j = 1,2}. 


A result of J. R. Silvester [IS] shows that, given a block matrix M = E 

A4„ft(C), where each Mij is a square matrix of order n over a held or a commutative ring, 
if all the blocks commute with each other, then the determinant det M of the full matrix 
equals the determinant of the n x n matrix DET{M, n), which is the formal determinant 
of M in terms of its block entries. 


Example 2.6. Let M = 


Mil 

Mi 2 

Mi 3 

M21 

M2 2 

M 23 

CO 

M 32 

CO 

CO 


where M,-,- is a submatrix of order n of 


M, for all i,j, and suppose that MijM^s = Af, 
equals the determinant of the n x n matrix 


rsMij, for all i, 


= 1, 2, 3. Then det M 


AfilAf22Af33 + Mi2M25M^i + M13M21M32 ~ Afi2Af2lAf33 — Mi^M22M^i — MnM2^M^2- 


Keeping in mind this property, we want to give some conditions to get the commutativity 
of the blocks of the matrix A I B described in Lemma 12.41 

Lemma 2.7. Let A E A4n(C) and B E A4m(C) be two nonzero matrices. Then the blocks 
of the matrix AI B, regarded as a matrix of order m"' whose entries are matrices of order 
n, commute with each other if and only if A is diagonal. 

Proof. We have seen in Lemma 12.41 that the blocks of order n of the matrix 

n 

AlB = C^ ^A + Y, IT" 0 Ci 

i=l 
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are either of type A + ^fh+iJh+^^h main diagonal) or of type bijC^A 7 ^ j 

(off the main diagonal). It is clear that, if at least one between A or S is the zero matrix, 
then all these blocks commute with each other. For this reason, in this lemma we restrict 
our attention to the case A ^ On and B 7 ^ Om- First of all, note that the matrices CiS 
commute with each other, more precisely we have 

^ 3 

\ if z 7 ^ j. 

The matrix A commutes with all the Q’s if and only if it is a diagonal matrix. In fact, 
ACi is the matrix with all zeros, except for the Fth column which equals that of A. On 
the other hand, CiA is the matrix with all zeros, except for the Fth row which equals 
that of A. Therefore, hxed an index i G {1,..., n}, we have ACi = CiA if and only if one 
has ttij = ttji = 0, for each j 7 ^ i. Now it suffices to apply the distributivity of the matrix 
multiplication and the claim follows. □ 

Remark 2.8. We observe that, in this setting of a diagonal matrix A, after computing 
the determinant of the block matrix DET{A I B,n), we get a polynomial expression in 
terms of the matrices A and Q’s; in fact, it follows from Lemma [2.41 that the diagonal 
entries are of type A + Ylh=i ^fh+^Jh+^^h, with G {0,..., m — 1}, and the entries off 
the main diagonal are of type bijCh, for some z, j G {1,..., m}, i 7 ^ j, and /i G {1,..., n}. 
Moreover, the matrix corresponding to the expression given by this polynomial (whose 
determinant equals the determinant of the full matrix A I B) is diagonal as a sum of 
products of diagonal matrices. This implies that the matrix DET{A I B, n) has full rank 
(and so Al B has full rank) if and only if the matrix DET{A I B,n) contains no zeros on 
the main diagonal. 

We can summarize our discussion with the following result. 

Proposition 2.9. Let A G At„(C) be a diagonal matrix. Then the only nonzero contri¬ 
bution (up to the sign) to DET[A I B,n) are of the following types: 

(V (nr=i Ck, for some th G {bij : i ^ j} and k e {1,..., n}; 

(^) nr=i + Eg,=i KCq}j X (Uh^r for somc bq^ G [hi : z = 1,... ,n}, 

1 < s < m", th G {bij i ^ j} and k E {I,... ,n}. 

Proof. The proof easily follows from Lemma [231 The only nonzero summands that appear 
in the determinant are either those in which each factor is a scalar multiple of the same 
matrix Ck, for some fc = 1 ,..., n, or those in which the factors are scalar multiples of the 
same matrix Ck, together with some blocks from the main diagonal. These two cases are 
described by ( 1 ) and ( 2 ) in the assertion, respectively. □ 

In Corollary 15.51 we will give an explicit description of the determinant of Al B for a 
diagonal A and a uniform B, by using the spectral analysis developed in Section [5] for 
Al B, in the more general case of a circulant matrix B. 
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3. Wreath product of graphs and the Lamplighter random walk 

We start this section by recalling the classical dehnition of wreath product of two graphs 
mm, then we show that it is a graph-analogue of the wreath product of matrices 
introduced in Dehnition 12.11 More precisely, we prove in Theorem 13.21 that the wreath 
product of the normalized adjacency matrices of two (regular) hnite graphs provides the 
normalized adjacency matrix of the wreath product of the graphs. We use the symbol ~ 
to denote adjacency of two vertices in a graph. 

Definition 3.1. Let Q\ = {Vi^Ei) and = iV^iE^) he two finite graphs. The wreath 
product Qi IQ 2 is the graph with vertex set >^Vi = {{f,v)\f:Vi^V 2 , n G ih}, where 
~ (/',n') ifi 

(1) either v = v' =: v and f{w) = f'{w) for every w and f(y) ~ f'(v) in Q 2 ; 

(2) or f{w) = f'{w), for every w G Vi, and n ~ n' in Qi. 

Observe that, if Qi is a di-regular graph on ni vertices and Q 2 is a (i 2 -regular graph on n 2 
vertices, then Qi ? ^2 is a (di -|- (i 2 )-regular graph on vertices. 

The wreath product of graphs represents a graph-analogue of the classical wreath product 
of groups: more precisely (see Theorem 2.1 in [IQ]), it is true that, with a particular choice 
of the generating sets, the wreath product of the Cayley graphs of two hnite groups is 
the Cayley graph of the wreath product of the groups (see also a generalization of this 
construction therein). 

It is a classical fact (see, for instance, IZDl) that the simple random walk on the wreath 
product Q\ IQ 2 of two graphs is the so-called Lamplighter random walk, according with the 
following interpretation: suppose that at each vertex of Qi there is a lamp, whose possible 
states (or colors) are represented by the vertices of Q 2 (the color graph), so that the vertex 
(/, v) of Q 1 W 2 represents the conhguration of the |Vi| lamps at each vertex of Qi (for each 
vertex u G Vi, the lamp at u is in the state f{u) G V 2 ), together with the position v of 
a lamplighter walking on the graph Qi. At each step, the lamplighter may either go to a 
neighbor of the current vertex v and leave all lamps unchanged (this situation corresponds 
to edges of type (2) in Qi I Q 2 ), or he may stay at the vertex v E Qi, but he changes the 
state of the lamp which is in n to a neighbor state in Q 2 (this situation corresponds to 
edges of type (1) in Qi I ^ 2 ): this model is also called the '^Walk or switch''’model. 

Recall that the normalized adjacency matrix of an (undirected) d-regular graph Q = 
{V,E) is the square matrix A = (a^) of order |I/|, whose entry Oij equals the number of 
(undirected) edges connecting the Tth and the j-th vertex of Q, divided by the degree d. 
We are now ready to prove the following theorem. 

Theorem 3.2. Let Ai be the normalized adjacency matrix of a di-regular graph Qi = 
{Vi, El) and let A 2 be the normalized adjacency matrix of a d 2 -regular graph Q 2 = ( 14 , E 2 ). 

Put \Vi\ = Ui, for i = 1,2. Then the wreath product [^p^A^ I ^^^q^A 2 j is the normal¬ 
ized adjacency matrix of the graph wreath product QilQ 2 - 
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Proof. First of all, observe that the wreath product I is a square 

matrix of order riin^^, which can be rewritten as 


di 

di + d2 


(4r ^ ^i) + 


(^2 

dl + ^2 



In order to show the assertion, it suffices to order the vertices {(/, n) : / : fh —t 14, n G Vi} 
of Gi I Q 2 in the following suitable way. 

First of all, let Vi = {vi,..., v^} and 14 = {ui,..., Un 2 }, both with the natural ordering 
such that Vi precedes Uj+i in I 4 , and uj precedes uj+i in 14. Observe that these orderings 
reflect on the rows and columns of the matrices Ai and A 2 , respectively. Let ns introduce 
a lexicographic ordering in 14 ^^, by saying that / precedes g in 14 ^^^ if there exists an index 
z G {1,..., rii} such that /(uj) precedes g{vi) in 14, and f{vh) = g{vh) for each 1 < h < z. 
Finally, we say that (/, n,) precedes {g, vf) in x 14 if 


• either / precedes g in 

• or f = g, and Vi precedes vj in 14 - 


Observe that, with this ordering, the summand 




corresponds to edges of type ( 2 ) in i ^ 2 , namely (/, Vh) ~ (/, Vk), for some / : 14 ^ 14 
and with Vh ~ Vk in Qi. As the total degree of the graph Qi I Q 2 is di + 1 ^ 2 , and the degree 
of Qi is dl, such a summand must be multiplied by the factor ■ 

On the other hand, the summand 


corresponds to edges of type ( 1 ) in Qi I Q 2 . more precisely, (/, v 

i } {g,Vi), with f{vj) = 

g{vj) for each Vj 7 ^ Vi and /(uj) ~ g{vi) in ^ 2 - In particular, the matrix Q takes into 
account the fact that the lamplighter stays at the vertex Vi. Since the total degree of 
Qi I Q 2 is dl + d 2 , and the degree of Q 2 is d 2 , this second summand must be multiplied by 
the factor This concludes the proof. □ 

Corollary 3.3. Let Qx = (14,4) a regular graph of degree di, and let Q 2 = (14,4) 
he a regular graph of degree d 2 . Let Ai (resp. A 2 ) he the normalized adjacency matrix of 

Qi (resp. Q 2 ). Then the wreath product (yd^^A^ I is the transition matrix of 

the “Walk or switch”Lamplighter random walk on the graph Qi, with color graph Q 2 . 


Example 3.4. Let Q\ be the cyclic graph of length 3, and consider on the graph Q\ the 
“Walk or switch” Lamplighter random walk, where the lamp set consists of exactly two 
colors, let they be 0 and 1: such colors can be identified with the vertices of the segment 
graph Q 2 (see Figured]). In other words, we can write I 4 = {0,1, 2} and I 4 = {0,1}. The 
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normalized adjacency matrices are 

1 l\ 

Ai = - \ 1 0 1 and A 2 = 

^ \ 1 1 0 / 

Then the wreath product (|^i) I (|^ 2 ) is the transition matrix of the “Walk or switch” 
Lamplighter random walk on Q\. The graph Q\ IQ 2 is represented in Figure [2j The vertex 
denoted by UiU 2 Us, Vi represents the situation where the lamplighter is at the vertex Vi of 
Qi, and Uj G V 2 is the state of the lamp at the vertex Vj G Vi- 

2 

• - • 

0 1 


Figure 1. The graphs Qi and ^ 2 - 





In Subsection 15.21 we will determine the spectrum of the Lamplighter random walk with 
two colors, by using the spectral analysis developed for the wreath product of matrices. 

4. The map F 

In order to characterize matrices which commute with respect to the wreath product, we 
introduce and study in this section a map F : A4„(C) x Aim{C) —> dehned 
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as 

F{A,B) = AlB, yAe Mn{C),B e Mm{C). 

We start with the following lemma. 

Lemma 4.1. The map F is a homomorphism of vector spaces. 


Proof. By dehnition, we have 

F{{A,B) + {C,D)) = F{A + C,B + D) 


= /! 


(A + C) 


i=l 


J2C‘~'<i>(b + d)0C"'‘0C, 

n 

IT'» D <g, IT" <g, a 


2=1 


iT®c + Y^ 

2=1 

AlB + ClD 


= F{A,B) + F{C,D), 

for all A, C G Aini^.) and B, D E Alm(C). Now let h E C. By dehnition: 
F{h{A,B)) = F{hA,hB) 


IT ® ('1-4) + E ® (hB) 0 IT 

2=1 

n 

h(lT <»A)+hY^lT~'<»B®lT~ 

2 = 1 
n 

^ A+ Y, ® Ci 


C, 


c, 


= h\r 


2=1 


= hF{A,B), 

for all A E Ain{C), B E The lemma is proved. 

Proposition 4.2. The kernel kei F of the homomorphism F is —him), h G C}. 


□ 


Proof. Recall that we have already remarked in Equation ([T]) that {(h/„, — him ), h G C} C 
ker F. We start our proof by showing that {A, B) ^ ker F whenever at least one between 
A and B is not diagonal. First, suppose that the matrix B = is not diagonal, 

so that there exist two indices i' ^ j' such that 7 ^ 0. This implies that the matrix 
hi'j'I^ ®Ci is nonzero. On the other hand, if we regard now the matrix F(A, B) = AlB 
as a block matrix of order m whose entries are matrices of order nnF~^, then it is easy to 
check that the submatrix occupying the position {i',j') is given exactly by biipl^ ®Ci, 
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and so it is nonzero. Hence, in this case, F(H, B) ^ Onm^- 

Let us suppose now that the matrix A = is not diagonal. Then there exist 

two indices ^ j' such that 0 */^/ 7 ^ 0. In this case, it is useful to regard Al B as & block 
matrix of order m" whose entries are matrices of order n. In such a matrix, the block 
corresponding to the entry ( 1 , 1 ) is occupied by the matrix 

n 

A + biiCi = A + buin, 

i 

according with Lemma 12.41 As the entry Oj/y of A is nonzero, this matrix is certainly 
nonzero. 

Thus, for the remaining part of the proof, we can suppose that both A and B are diagonal 
matrices. When F{A, B) = Onm^, then it must be A + buIn = On- This equality between 
matrices gives rise to the n equations 

Oil + ^11 = 0, 022 + ^11 = 0, . . . , ttnn + = 0 


and so we have: 


h Oil — 022 — • • • — Qnn — “^11- 


Analogously, for each j = 1,... ,m, the entry {j,j) of tho matrix F{A, B) = Al B (seen 
as a matrix of order m"' whose entries are matrices of order n) is A + (/„ — C„) + bjjCn, 

according with Lemma 12.41 Since we have supposed F{A, B) = then, for every 

j = 2 ,..., m, it must be: 

{ h + bii ^ 

h + hii 

\ h -\- bjj / 

what implies &ii = 622 = ■ ■ • = = —h. The claim follows. □ 


Corollary 4.3. Let A and B he two square matrices of order greater than 1. Then 
Al B = B I A if and only if A and B have the same order and differ by a multiple of the 
identity matrix. 


Proof. First of all observe that, if we exclude the trivial case where at least one between 
A and B has order 1, the matrices A I B and B I A have the same order if and only if the 
matrices A and B have the same order, let it be n. In this case, both A I B and B I A 
have order Now we have 

AlB = BlA^ F{A, B) = F{B, A) ^ F{A -B,B-A) = ^ A- B = hin, 

for some /i G C, according with Proposition 14.21 □ 

In other words, two matrices A and B commute if and only if they differ by a multiple 
of the identity matrix. This can also be reformulated by stating that the centralizer of a 
matrix A G A4„(C) is given by Centr{A) = {A + /i/„, h G C}. 
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5. Spectral computations 


In this section we investigate the spectral properties of the wreath prodnct Al B oi two 
matrices. We focus our attention on the special case of a circulant matrix B, that is, we 
assume: 


(2) B 


/ h bm-l\ 

bm-1 bo bi 

••• ••• b, 

\ bi bjn-i bo / 


with G C, Vz = 0,..., m — 1. 


From now on, we will denote by CirCm{C) the vector subspace of Wlm(C) consisting of 
circulant matrices. The reader can refer to [7] as an exhaustive monograph on circulant 
matrices. 


Before starting our spectral computations, we discuss some further properties of the map 
F defined in Section |H when it is restricted to the complex vector space M„(C) x C'zrCm(C). 
Recall that a basis of the vector space Mn{C) is given by 


{Eij : i,j = 1,... ,n}, 


where the entry e^k of Eij satisfies 

^hk 


1 , = 

0, otherwise 


for h, k = 1,... ,n, 


whereas a basis of the vector space CzrCm(C) is 

{Circi : z = 0,..., m — 1}, 
where the entry Chk of Circi satisfies the condition 


Ohk — 


1, ii k — h = i mod m 
0, otherwise 


for /i, fc = 0,..., m — 1. 


Observe that the following identities hold: 

CircJ = Circm-i, CirciCircj = Circi+j = CircjCirci, Vz, j = 0,1,..., m — 1. 

Note that the sum i+ j must be taken modulo m. The basis of the vector space Mn{C) x 
C'zrCm(C) is defined in the obvious way. It follows from the dehnition of wreath product 
that 

F{E,„0 

m) ^ ^ Ei^kn,j+kn 
k=0 

SO that, with respect to the description given in Lemma [2.41 the only nonzero blocks of 
order n are the m"' diagonal blocks of type Fij. On the other hand, we have: 


F(On, Circj) = (g) Czrcj ® /y ‘ ® Q, 

i=l 
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SO that in this case we only have blocks of type (7^, for /c = 1,..., n. Observe that 

F ^ Eii, OirCo^ Im) 

as it follows from the description of ker F given in Proposition 14.21 In particular, if we 
put 

Fa = F (M„(C) X {Om}) Fb = F {{On} X CtrcUC)) , 

we have dim(FyinFe) = 1, and more specihcally F{Y}}}^i F^, Om) = F{On, Circo) = Inm^- 

The spectral properties of circulant matrices enable us to give the following result. 

Theorem 5.1. Let A G A4n(C), and let B G C'irCm(C) be a circulant matrix as in (l2i) . 
Then the spectrum S of AlB is obtained by taking the union of the spectra of the 

m"' matrices of order n given by 

n m—1 

(3) 

1=1 1=0 

where Zj G {0,1,..., m — 1}, for every j = 1,... ,n, and p = exp (^). 


Proof. It follows from the definition of wreath product that, if i? is a circulant matrix, 
then A I B can be regarded as a matrix of type 



/ Mo 

Ml 


Mm- 

i\ 



Mm- 

1 Mo 

Ml 




AlB = 











Mi 




\ Ml 


Mm-l 

Mo 



where each block Mj has order nm"' 

for 

every z = 0, 

.. ,m 

— 

1. In other words, the 


matrix Al B is a. block circulant matrix, with blocks of order nm"^ More precisely, we 
have: 

n—1 

M„ = /®”-‘ ® .4 + b„lS'~' ® c, + ^ If;-' 0 B 0 /f - ® C.+. 

i=l 

and 

M, = b,C"-" Vz = l,...,m-1. 

The spectral analysis developed in [19] for block circulant matrices implies that the spec¬ 
trum of A ^ i? is given by the union of the spectra of the m matrices 


m—1 


___ /27Ti\ 

^ for zi = 0,..., m — 1 and p = exp f-j . 

h=o \rn J 
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By using the explicit expression of the matrices given above, we obtain that also the 
matrix is a block circulant matrix, of type 

Mr 


M*i = 


\ Mr 


m—1 


Mr 

M- j 


where each block has order nm^ In particular, we have: 


M'„' = C' 

n—2 


A + Bqj 


Co 


m—1 




i=l 


”■^0 5 ® 0 ^+2 + 

i=0 


Cl 


and 


Mr = h 


1 m 


C 21 Vf = 1 ,..., m — 1 . 


Now we can apply again the theory from [12], and we deduce that the spectrum of the 
matrix M*b for each ii = 0 ,..., m — 1 , is obtained as the union of the spectra of the m 
matrices 


m—1 

h=0 


with Z 2 = 0 ,..., m — 1 . 


Observe that in the expression of there is one Kronecker product less than in M^. 
Now, the matrix is still a block circulant matrix with m x m blocks, each of order 

By iterating this argument, we conclude that the spectrum of the matrix A I B 
is obtained by taking the union of the spectra of the m” matrices of order n 

n m—1 

t=l i={) 

where the n-tuple (ii, Z 2 ,..., in) varies in {0,1,..., m — 1}"'. The claim follows. □ 


In the case n = 2, we are able to give an explicit description of the spectrum oi Al B. 

a b 


Corollary 5.2. Let A = dj ^ M. 2 {C-) and let B G CirCm{C) he a circulant matrix 
as in (]2|) . Then the spectrum ^ of Al B is given by 

E= U 






with 


y _ I J2i=0 + a + d 1 

ii,i 2 s 2 2 




^ m—1 


— p®®2) + a — d 


Abe 


. 2=1 
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k 

k 

Eii,i 2 

0 

0 

3; 4 

0 

1 

q. 5 , 3x/3 • 

0 

2 

q. 5 3\/3 • 
o, 2 2 ^ 

1 

0 

4 . 3 I 3^^ 

Gfc, 2 ^ 2 ^ 

1 

1 

3 1 3^/3 •. 5 , 3^/3 • 

2 T 2 2 9 ^ 

1 

2 

3 I 3V3- 5 3v^- 

2 

0 

3 3v4 - 4 

9 9 ^ 

2 

1 

3 3x/3 •. 5 , 3V^ ■ 

2 5> C 5 T ^ t 

2 

2 

3 3^3 •. 5 3^3 ■ 

9 9 9 9 ^ 


Table 1. Spectrum of the matrix Al B oi Example 15.31 


and p = exp (^). 


Proof. Let 


A = 


a b 
c d 


( bo b, 

bm-i bo bi 


B = 


bm—l^ 


••• ••• b, 

\ bi bra-l bo ) 

and let Zi, Z 2 G {0,..., m — 1}. Then the matrix (jS]) reduces to 


= 


_ r«+Er=o^ 


b 

1 


An explicit computation shows that this matrix has spectrum 


^^2 


+ /*') + a + d 1 


y^- • — 


± 


A 


' m—1 


bi{p^^^ — p®* 2 ) + a — d I + 46c 


2=1 


and the claim follows. 


□ 


Example 5.3. Let A = 


1 1 
0 2 


and B = 


shows that the eigenvalues of the matrix A I B are 



A direct computation 


, ^ 5^3^/3. 3^3\/3. 

4; 3; - ±- 1 : - ±-z, 

2 2 2 2 


where each eigenvalue occurs with multiplicity 3. The spectrum of the matrix 

for all A, Z 2 = 0,1, 2, is described in Tabled! 
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5.1. The case of a diagonal A and a uniform B. Consider now the special case where 
d is a diagonal matrix and i? is a multiple of the uniform matrix J^, so that 


/ ai 

02 

\ 

, Oj G C and 

B = h 

/ 1 

... IX 

V 

J 




... i) 


The spectrum of A I B, under these hypotheses, is explicitly described in the following 
theorem. 


Theorem 5.4. Let A G Afn(C) be a diagonal matrix, with k-th diagonal entry egual to 
Qk G C, and let B = hJm, where /i G C and Jm is the uniform matrix of order m. Then 
the spectrum of Al B is 


U U 


m—1 

Ok + hy^y 

j=0 


'^k 


p = exp 


271A 

m J 


Therefore 

n 

det(A ^ i?) = P[(afc + mh)'^’^ ^ 

k=l 


Proof. With the notation used in Equation ([3]), we have in this special case 


/ ai 




02 


V 



n m—1 


7=1 j=0 


so that the matrix is a diagonal matrix, whose k-th diagonal entry is equal 

to Ofc + /tr'*'', with p = exp (^), for each k = 1,... ,n. This implies that the 

spectrum of the matrix Al B is given by 

n f m—1 

U U 



m—1 

Ofc + h ^ = 

j=0 


Now, observe that 


Ofc + mh, for 4 = 0; 
Ofc, otherwise 
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since ^ =0, for all 4 = 1,..., m — 1. Therefore, we get: 


det(A?i?) = 


n 


(ofc + mh) 


n 




ik—0 
n 

]^(afc + mhy 

k=l 


ik¥=0 


□ 


Corollary 5.5. Let A and B he as in Theorem \5.4\ Then the matrix AlB is singular if 
and only if there exists an index k G {1,..., n} such that = 0 or Ok = —mh. 


This result will be applied in Section [B] in order to study generalized Sylvester matrix 
equations by means of the wreath product of matrices. 


5.2. An application to the spectral analysis of the Lamplighter random walk. In 

this subsection, we investigate the spectrum of the “Walk or switch” Lamplighter random 
walk over a d-regular graph Q = {V,E), already introduced in Section [3l For the sake 
of simplicity, we assume that the color set consists of just two elements, that can be 
identihed with the vertex set of a segment graph (the color graph). 


According with Corollary 13.31 the transition matrix of this stochastic process is given by 


d 

d + 1 




5 


where A is the normalized adjacency matrix of the graph Q, and B 


0 1 
1 0 


. Observe 


that, in particular, the j^B is a circulant matrix, so that the spectral analysis developed 
in the hrst part of Section [5] can be applied. In particular, we know that the spectrum 
of the matrix I {-^B) is obtained by taking the union of the spectra of the 

matrices of order \V\ given by: 


7 -1 I I -L 

(4) =- A +-V V 

^ ^ d+1 

t=l 2 = 0 

where h G {0,1}, for every t = 1,..., |C|, and p = —1. 


Let us consider now the specihc case where the graph Q is the complete graph over n 
vertices; observe that this graph is an (n — l)-regular graph. With respect to the notation 
of (jl]), we have that 

dl=^(Jn-4) B=( 

n — 1 \ 


0 1 
1 0 
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where Jn and In denote, respectively, the uniform and the identity matrix of order n. 
Note that we have 6 o = 0, = 1, so that the matrix (jl]) reduces to 


/( 


M 




1 1 1 
-iJn-In) + -Ti-irCt = - 
n n n 

t=i 


_l)n 

1 

1 


1 1 

(- 1)^2 1 

1 


1 \ 

1 

1 (-1)*- / 


It turns out that the spectrum of the matrix only depends on the number k of 

indices equal to 1 in the n-tuple ■ ■ ■ ,in), whereas it does not depend on the position 

of such indices. In order to show that, we use the elementary permutation matrix Sij of 


order n, associated with the transposition 


/ 


instance, for n = 5, one has S 23 = 


{ij) of the symmetric group of order n. For 
0 0 0 \ 


1 

0 

0 

0 


Observe that = £ij, for all 


i,j = 1,... ,n. Let V 2 ) ■ ■ ■ ? V* be the entries of the n-tuple {ii,i 2 ,..., in) which are 
equal to 1 ; similarly, let jsi,js 2 j ■ ■ ■ )isk be the entries of the n-tuple • • • ,in) which 

are equal to 1. Let and pg corresponding matrices. Then one 

has 


^ g ■■■Si , ...g 

= is, i ■■■Si i ...g ^ 

\ IriJsi IriJsi 


Therefore, the matrices ’* 2 and MF’t 2 vjn g^],g conjugate, so that they have the 
same characteristic polynomial, and so they have the same spectrum. 


As a conseq^nce, for each h = 0,1,..., n, we can reduce to investigate the spectrum of 
the matrix corresponding to the n-tuple starting with k entries equal to 1 , 

whose remaining n — k entries are equal to 0. Put = Sp, with 


P — JnP Q, 

/ -2 \ 


where Q is the diagonal matrix Q = 



. Now we have: 


V 0 / 

det(A4 - P) = det (A/„ - Jn - Q) 

= det((A 4 -Q)(/„-(A 4 -Q)-V„)) 

= det(A4 - Q) • det {in - (A4 - Q)"V„) . 
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It is clear that 

det(A4 - g) = (A + 2 )’^ ■ 

Now it can be seen that the matrix {XIn—Q)~^Jn is the matrix of rank 1, whose first k rows 
are constant, with entries all equal to whereas the remaining n — k rows are constant, 
and with entries all equal to A. Therefore, (A/„ — Q)~^Jn has n — 1 eigenvalues equal to 0, 
and one eigenvalue equal to This implies that the matrix — (A/„ — Q)~^Jn 

has n — 1 eigenvalues equal to 1, and one eigenvalue equal to 1 — so that: 

det {in - {XIn - g)"Vn) = 1 - ^ ■ 

Then, by gluing together all the previous computations, we obtain; 

(5) det(A4 - P) = (A + 2)^-1 • • (A^ + (2 - n)X + 2 k- 2 n). 

For the particular value A: = 0, we get: 

(6) det(A4-P) = A”-P (A-n); 
similarly, for the special value k = n, we have: 

(7) det(A4-P) = (A + 2)"-P (A + 2-n). 

We deduce the following theorem. 


Theorem 5.6. The spectrum of the transition matrix of the “Walk or switch”Lamplighter 
random walk over the complete graph Kn is given by S = ULo 

f 2 n -2 

^0 = {0 (multiplicity n — 1 )] 1} S„=<- (multiplicity n — 1 )] 


n 


n 


and, for each k = 1 ,... ,n — 1 : 
2 


Si, = 


n 


(multiplicity k — If, 0 (multiplicity n — k — If 


n-2± v/(n + 2)2-8A;' 
2 n 


Proof. Observe that S is the spectrum of the matrix = Ap. Therefore, it 

suffices to normalize by n the roots of the characteristic polynomial (|S]), for 1 < k < n, 
taken with multiplicity (”); of the characteristic polynomial ([2]) for A; = 0; and of the 
characteristic polynomial ([7]) for k = n. □ 

Remark 5.7. Notice that in the previous computations we had B = Circi G Wl 2 (C). 
In principle (with an amount of computational difficulties) analogous computations can 
be performed for any circulant matrix B = UCirCi G 2Wm(C), with p G {0,1}, 

provided that such a linear combination gives a symmetric matrix, which can be regarded 
as the adjacency matrix of some (circulant) color graph. In this case, the total degree of 
the corresponding wreath product of graphs would be n — 1 + |{i s.t. U = 1}|. 
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6. Application to generalized Sylvester matrix equations 

In this section, we address the qnestion whether it is possible to hnd conditions to guar¬ 
antee that the matrix A I B has full rank. This problem is related to the solution of the 
so-called Sylvester matrix equations. J. J. Sylvester studied the equation AX + XB = C, 
where A G A1„(C), B G Alm(C), C G Alnxm(C) are given, and one wants to determine 
the matrix X G Al„xm(C). It is well known that the solution of this equation exists and 
is unique if and only if A and —B have no common eigenvalue [2]. Actually, Sylvester 
studied also the more general equation 

k 

( 8 ) = 

i=l 

with Ai G Alnxm(C), Bi G Alsxt(C), and C G Xinxt{C). Many methods were developed 
to solve this kind of equations (see, for instance i). Here, we are interested in finding 
a sufficient condition to guarantee that the Equation ([8]) admits a unique solution. The 
connection between the solution of the Equation ([8]) and the wreath product of matrices 
is given by the following lemma. Given an m x n matrix M, we denote by Vec(M) the 
column vector of length mn obtained by stacking the columns of M on top of one another. 

Lemma 6.1. Let Ai G Al„xm(C), Bi G Alsxt(C), and C G Al„xt(C). The equation 
^i^Bi = C can be rewritten in the form 

(Hf G) Ai + ■ ■ ■ + G) Afc)Vec(A) = Vec(G). 

Proof. Let us start by considering the case fc = 1, so that we look at the equation AiXBi = 
C. We denote by by by and by 

{xij}i=i^,,,^rn-,j=i,...,s the entries of the matrices Ai,Bi,C,X, respectively. 

Now the entry of C equals Uihbhj, where yih is the entry (f, h) of AiA. Therefore: 


(9) 


s / m 


Cij 


^ ^ j ^ ^ I bfij 


h=i \e=i 

m / s 


EE bjh^ii I ^Ihi 

e=i \h=i 


where bjh denotes the entry {j, h) of Bf. Notice also that Cij occupies the ((j — l)n-(-f)-th 
entry of the column vector Vec(G), by definition. On the other hand, ([9]) is exactly the 
entry {j — l)n + i of the column vector [Bf G) Ai)Vec(A), as it can be regarded as the sum 
of the componentwise products of the elements of the ((j — l)n -|- f)-th row of Bf 0 Ai, 
with the column vector Vec(A). This concludes the proof for the case k = 1. 
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Now for every k > 1 consider the equation = C. By proceeding as before, 

we are led to the equation 


( 10 ) 


Cij 


m / s / ^—s 

X] ( X] ( ^-^ 

l=\ \h=l ^ 




'i£ 


xeh, 


where denotes the entry {i,i) of Ap+i and the entry {j,h) of -Bj+i, for each 
p = 0,...,/c — 1. On the other hand, the right-hand side of flTU]) is exactly the entry 
{j — l)n i of the column vector {Bf (8) Ai -|— ■ -|- B'^ ® y4fc)Vec(X), as it can be regarded 
as the sum of the componentwise products of the elements of the ((j — l)n -|- z)-th row of 
BJ (8) Ai ■ -f (8) Aki with the column vector Vec(X). This concludes the proof. □ 


The previous result leads to the following proposition. 

Proposition 6.2. Let A G At„(C), B G and let Ci he as in Definition \2.1[ for 

each z = 1,..., n. Put 

Ai = A, A2 = Cl, ., An+i = Cn 

and 



Then the equation AiXBi = C has a unique solution if and only if Al B has full 

rank. 


Proof. The statement follows from Lemma 16.11 by observing that the matrix multiplying 
Vec(X) coincides with A I B. Then the linear system [A I B)Vec{X) = Vec(C') has a 
unique solution if and only if the matrix A I B has full rank. □ 


It follows that, if det(A I B) ^ 0, then the solution of the corresponding matrix equation 
given in Proposition 16.21 is unique. In particular, the following corollary gives a sufficient 
condition for the uniqueness of the solution of a special type of Sylvester matrix equations. 


Corollary 6.3. Let A and B be as in Theorem 5.4 
k G {1,..., n} such that = 0 or Ok = —mh. 
defined as in Proposition \6.A Then the equation 


, and suppose that there exists no index 
Let Al,..., Anj^i and Bi,..., B^+i be 


n+1 

AiXB, = C 

1=1 


admits a unique solution X. 


Proof. It directly follows from Corollary 15.51 


□ 
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